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7.5 PHOTOGRAMMETRIC ASPECTS OF REMAPPING PROCEDURES* 

Edward M. Mikhail, Purdue University ^ ^ 

The presentation will discuss aspects specific to photograrnmetry, particularly 
photogrammetric control generation. In order to avoid having this talk be 
more or less tutorial, I will, at the end of the talk, make the discussion 
relevant to remote sensing data reduction. 

Referring to Figure 1, the outline, I will briefly go through several aspects 
of photograrnmetry, including a classical definition of rectification vrtiich 
existed in photograrnmetry for many years and then show how it changed fit 
the context of what we do at present with remote sensing data. Since I was 
specifically asked to discuss triangulation, or at least ground control gener- 
ation photogrammetrically. I'll be talking a little bit about that and tnen I 
will go into the MSS aircraft data work that we've been doing at Purdue at 
least in my area of engineering for over seven years. At the end, I hope to 
have time to offer some conclusions. 

There are broad definitions for photograrnmetry. However, as shown in 
Figure 2, I'm going to concern myself here with extracting information from 
photographs and images that are of metric quality. Fundamentally a photograph 
or an image, no matter which way it is acquired, is basically a two-dimension- 
al representation of a three-dimensional space. This is shown schematically 
in Figure 3 for a frame photograph. If we do not take this fact into consid- 
eration, we are likely to have problems, and I'm sure many of us have >ad 
that. 

In order to recover the information about the object, we basically are going 
in the direction from where the data was acquired back into the object, and 
the only way we can get the information correctly is to do one of two things. 
Either to assume that the object is an average plane like it was desired yes- 
terday by Fred Billingsly, or we would have to have an external source of 
information about the object itself, such as having a digital elevation model 
as I will mention a little bit later. 

Obviously an alternative to that, which is a typically photogrammetric solu- 
tion, is to have more than one ray, and there was a question, at least one 
raised yesterday as to what the impact of having more than one image record is 
on the accuracy. I will show some results on that as well later on. Figure 4 
is a schematic of three conjugate rays from three frame photographs. 

Rectification, classically, was related specifically to a reprojection, and, 
in the context of a frame photograph, we assume that it is a perspective pro- 
jection of a three-dimensional space, as shown in Figure 5, the original pho- 
tograph was oriented not necessarily with the optical axis of the camera 
pointing downward. And what we would like to do is to get another equivalent 
vertical photograph through a transformation. The new equivalent photograph 
wculd represent a mean plane in the terrain itself. An extension to this is 
referred to as differential rectification in photograrnmetry and requires 
having more than one photograph. Figures 6, 7 and 8 show schema' ics in which 
the terrain is represented with small segments, each of which is differential- 
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ly rectified, that is to say, now pa'*allel to the datum and then placed pro- 
perly so that the elevation effect has been taken into account. This is the 
procedure that produces the orthophotos as is known in photogrammetry . The 
equivalent to that is to consider a single image, either a frame perspective 
photograph segmented into small patches or, in the case of the MSS imagery, to 
consider each of the pixels as if it were a segment. And if you have a digi- 
tal elevation model, and if you want a full rectification in the photogram- 
metric sense, then you can merge these two together, and you can properly 
locate each one of those elements back relative to the terrain datum. I w£.nt 
to say that as far as map projection is concerned, that does nothing other 
than to change the frame of reference of the data. It has absolutely nothing 
to do with the fact that you are going either from three-dimensional to two- 
dimensional or multiple two-dimensional back to three-dimensional. The map 
projection is strictly a means of projecting the surface onto a map. So it*s 
not the same thing at all. 

Now, we iiiove on to the triangulation, which is the procedure for getting con- 
trol. There is quite a lot of detail that I should go through but I cannot, 
due to lack of time. There are different types of procedures for triangula- 
tion as shown in Figure 9. For our purposes here, the one most commonly used 
technique is analytical triangulation where a Icrge number overlapping images 
can be simultaneously reduced in such a manner as to produce very high accur- 
acy control. The idea is to have multiple rays for every point on the terrain 
for which you require the X, Y, and Z location, as shown in Figure 10, and for 
each of those rays, you write the proper equations. And then you reduce the 
entire set of multiple rays simultaneously in one analytical ^eduction method. 
Before you do that, you need to have at least estimates for the unknowns you 
sought for. 

Figures 11 and 12 show situa'oions which are rather idealized for a typical 
block of 20 aerial photographs, and the corresponding structure of normal 
equations used to derive supplementary control. The lower half of Figure 9 
indicates that analytical triangulation has reached a very high degree of so- 
phistication. Everything that enters the mathematical model is considered a 
stochastic variable including the ground control that is externally obtained 
by ground means. And you will enter the image coordinates as observable with 
their a priori Irnown covariance matrices. All the possible systematic errors 
that occur are corrected according to the best models available. Control re- 
quirements are: for the horizontal control, you need it around the perimeter; 
for the vertical control, you need it well distributed through the block. 

Figure 13 shows what are called the colinearity equations. Those are for 
frame photographs but can be modified for a continuous strip camera which is 
the exact equivalert of the pushbroom linear array; it can be modified for 
panoramic photographs and also for the n. Itispectral scanner imagery. 

So we have the mathematics to go from regular photogrammetric reduction to MSS 
reduction. In fact, we have done all that at Purdue, including the block ad- 
justment of MSS data. I will show you some results if I have a chance at the 
end. 

What do we do if we have several hundred photographs and for each of the pho- 
tographs, there are six unknowns. We end up with a very large system of line- 
ar equations, actually they are originally nonlinear, but are linearized. We 
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take advantage of the characteristics of the normal equation structure which 
is very sparsely populated by nonzero elements as shown in Figure 17. We also 
take advantage of techniques of folding parts of this matrix in sue* a way 
that we end up with only a subset of the unknowns, and it gives us a banded 
bordered structure of matrices which are relatively efficiently reduced. 

So what do we get from the analytical triangulation scheme? Well, we will 
basically get X, Y and Z for all points of interest for which we had input 
image coordinates, based on a skeleton of control points around the perimeter 
and a few in the center. As regards accuracy, working with frame photography, 
and this of course may probably look out of context here, we can go down to 
three micrometers at the plane of the image for the control that we have ob- 
tained from aerial photography (Figure 9). 

The last section of this talk briefly covers work we did at Purdue. Three 
papers, listed as references, will briefly be discussed. Figure 1A shows the 
detailed outline for the first paper, essentially a survey paper giving the 
mathematical models we use when we actually deal with MSS images as if they 
were photogrammetric blocks of photographs. The idea is that for each one of 
the locations of the sensor you would have nominally six parameters describing 
its location and attitude. This would lead to six parameters per pix'l if we 
treat the problem in a vigorous manner, which would lead to a very la. ge num- 
ber which would be impossible to reduce (see Figure 15). For the case of the 
pushbroom scanner, we have six parameters for each line. For practical pur- 
poses we segment the image, and consider each segment as if a photograph had 
six elements (X^, etc.). We then consider each of those elements as If it 
were a function of time. There is a large number of possibilities with w'. ioV' 
we actually model the exterior element and I have several of those already 
mentioned in those papers. There are two basic techniques: either to specifi- 
cally model everything we know about the sensor, or to use some interpretive 
technique in order to get the information. 

Another important aspect is to consider whether we want to work with only sin- 
gle images which have the limitation of considering only horizontal (or X, Y) 
information, or we will work with the block adjustment which then gives us 
also the Z. In consideration of the Z, there are two ways of looking at this 
problem: either using the remoue sensing data for mapping purposes, or for the 
purpose of merging the MSS information to other sc^^rces of data, which would 
require only rectification. You want to rectify it but not use it for mapping 
as such. So everything Roy Welch said yesterday was to meet map accuracy 
standards as if the MSS or its equivalent (whatever the sensoi used) actually 
does the topographic mapping at appropriate scale. What I am saying here is 
related to the need to rectify the date so that you may derive other tyres of 
information from it. 

Figure 16 shows the single coverage results. One of the things that we did is 
to take i: strip of MSS imagery and segment it, write constraints between seg- 
ments so tr.at continuitj is preserved. As the number of segments increases, 
the check, or whac ever measures you have for accuracy, would improve up to a 
certain point and after that, of course, it levels off because the degrees of 
freedom are reduced (see Figure 17). Using real data from three sidelapping 
strips, the Z is indeed recoverable (see Figure 18). I don't know if the gen- 
tleman who asked the question yesterday regarding the use of ste~eo is here or 
not but he was wondering what would happen if you use overlapping imagery. 
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This not only produces the Z but it also improves the recovery of Jorizontal 
coordinates by 40 and 60J as shown in Figure 19. There are other aspects o*' 
this work, namely that you could adapt techniques from the block adjustment of 
photographs to be used with MSS. Notably, we have used geometric constraints 
such as points lying on straight lines (e.g., roads). The use of such con- 
straints can replace the need for control, or if used in addition to control, 
can lead to improved accuracy. 

In conclusion, we feel, in photogrammetry, that we were not reaily heeded as 
much as we ought to have been; there's a wealth of information, a wealth of 
technology that is useable with remote sensing imagery. Everything I’ve said 
here, of course, relates to aircraft MSS data which is the one thing I had 
continued to work with. We have not the equivalent tning with Laiidsat for 
obvious reasons It was a tremendous jump to go from the micrometei level to 
the 80-mcter resolution, so I stayed with the aircraft, 

I feel that I have just scratched the surface as far as the actual remapping 
topic. However, I hope that this with reference papers w li g.'’ e you a good 
idea of what can be gained when photogrammetric technology is considered when 
rectifying and/or registering remote sensing data. 
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Figure 3. Object Space and Exterior Orientation 
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figure 4. Scale Restraint Equation 
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Figure 6* Methods of differential rectificauon (a) Terrait. '»nd 
Corrcspo»tdtng contour mtip (b) Fixed line element strip rectification 
(c) Rotating line elemen! strip rectification (d) Plane area element 
fectification (c) Curved area element rectification After Edmond. Bcndix 
Technical Journal. Vol 1. No 2. 1968 
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* Accu'"acy: * Fraction of Flying Height (H/20,300 and Better) 

* Given c at Photo Scale (Down to 3 »jm) 
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Figure 11. Arrangements of Points in B1 
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Figure 14. Curi'ent Status of Metric Reduction 
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ORiGIf^AL PACE !S 
OF POOR QUALITY 


PARAMETRIC MODELS 

BASED ON LINEARIZED FORM 0? COLLI NEARI TV EQUATIONS 
EXCESSIVE KUI'BER OF SEt^SOR/PLATFORM PARAMETERS 
REPLACE SOFE OR ALL OF THE SIX PARAMETERS 

(X_, Y , Z , u), ip, K per pixel, line, or segment) 

C C Lr ^ 

BY FUNCTIONS. 

FOR ORBITAL C^SE: REPLACE \ BY FUTXTIONS OF 

THE SIX ORBITAL PARWIETERS 
OR USE A LINEAR SEQUENTIAL ESTIMATOR (kALMAN FILTER) 

FOR AIRCRAFT CASE: REPLACE PARAfCTERS BY POLYNOMIALS 

AND SEGMENT RECORDS - USE CONSTRAINTS 

(couj) USE harmonics) 

FOR EITHER CASE: USE AlH^OREGRESSIVE MOIEL (gA-USS-MARKOV 

process) 

Figure 15. Basic Mathematical Mode':. 
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ORlG'i?^AL PAG^ J^3 
OF POOR QvJAi-lTY 


INTERPOLATIVE MODELS 
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^ - PARAMETER 
6 - PARAMETER 
8 “ PARA'CTER 

GENERAL POLYNOMIAL (RUBBER SHEET) 


WEIGHTED :>1EAN 


MOVING AVERAGES 
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(new parameter ESTIMATION FOR EACH PCIITT) 


MESHWISE LINEAR 

(TRIAf>IGULAR OR RECTANGUUR MESHES - LINEAR ESTIMATIOI>f) 


LINEAR LEAST SQUARES PREDICTION 

(establish covariance FLWCTiaN) 


figure 15. Ccontir.uec} 
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Figure 16. Single Coverage Data CF/M) , Cheek point RMSE (pixels) 
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Mean Square Error (M), Number of Sections 



ORIGINAL r-;.CL iC 
OF POOR QUALITY 


NlftER OF RAYS 


NUFBER OF 

STRIPS 12 3 



X 

Y 

X 

Y 

z 

X 

Y 

z 

1 

16.7 

17.^1 

- 

- 

- 

- 

- 

- 

2 

17.3 

16.5 

11.5 

15.8 

54.2 

- 

- 

- 

3 

18.8 


1D.3 

12.8 

41.3 

8.9 

n.5 

27.3 


Figure 19. Check Point Root Mean Square Error 
For Single and Multiple Ray Points 
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